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Specification 

L. Title of the Invention 

Vehicular Predicted Path Display Device 

2. Claims 

(1) A vehicular predicted path display device displaying a predicted path and any one of 
an image of a rear and side rear field of vision on a screen when a vehicle is backing up, 
characterized by comprising a camera for projecting any one of a rear and side rear field 
of vision; a steering sensor for detecting a turning angle of a steering wheel; an image 
processing device for storing a predicted path image corresponding to a turning angle of 
the steering wheel when backing up, and reading out the predicted path image 
depending on a signal from the steering sensor when the vehicle is backing up; and a 
display device for overlapping and displaying a camera image and a predicted path 
image from the image processing device, 

(2) The vehicular predicted path display device according to claim 1, characterized in 
that the predicted path image includes an outline of the vehicle. 

3. Detailed Description of the Invention 
(Industrial Field of Application) 

The present invention relates to a display device for displaying an image from 
a television camera of a rear or side rear field of vision, which are blind spots when 
backing up a vehicle, and in particular, relates to a vehicular predicted path display 
device that superimposes a predicted path of a vehicle on an image of a field of vision. 
(Related Art) 

When driving, the driver can sufficiently check for safety in the forward 
direction of the vehicle because he or she can directly grasp the surrounding conditions 
within his or her field of vision along a predicted path. However, when backing up the 
vehicle, a considerable range behind and to the rear sides of the vehicle does not fall 
within the driver's field of vision. In this case, fender mirrors or rearview mirrors are 
required to supplement the field of vision. 

In particular, there are many blind spots in the driver's rear and rear side field 
of vision when in the vehicle. In larger vehicles such as trucks and buses, it becomes 
especially difficult to reduce blind spots with mirrors alone. Thus, television cameras 
have been used in order to discern the rear field of vision. One example in recent 
years is that of attaching a camera to a large vehicle, such as a bus, for the purpose of 
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securing a rear field of vision so that safety can be easily confirmed when backing up. 
(Problems which the Invention Attempts to Solve) 

However, the field of vision from the position of the camera is different from 
the field of vision viewed from the driver seat. Therefore, it is difficult for the driver 
to perceptually grasp the relationship between his or her manipulation of the vehicle and 
resulting vehicle action from the screen. Furthermore, watching the image while 
manipulating the vehicle is actually quite an arduous task due to the narrow camera 
angle of view. 

It is an object of the present invention to obtain and display an image of a rear 
or side rear field of vision with a camera such that the image is perceptually compatible 
with operating the vehicle. 
(Means for Solving the Problems) 

In order to achieve the above object, a vehicular predicted path display device 
according to the present invention displays a predicted path and an image of a rear or 
side rear field of vision on a screen when a vehicle is backing up, and is characterized 
by including a camera for projecting a rear or side rear field of vision; a steering sensor 
for detecting a turning angle of a steering wheel; an image processing device for storing 
a predicted path image corresponding to a turning angle of the steering wheel when 
backing up, and reading out the predicted path image depending on a signal from the 
steering sensor when the vehicle is backing up; and a display device for overlapping and 
displaying a camera image and a predicted path image from the image processing 
device. 

(Operation and Effect) 

In the vehicular predicted path display device according to the present 
invention, an image of a rear or side rear field of vision projected by a camera is 
displayed. When a steering wheel is manipulated, a predicted path corresponding to an 
turning angle of the steering wheel is read out by an image processing device, and the 
predicted path is superimposed on the image of the rear or side rear field of vision. 
Accordingly, the predicted path can be perceptually confirmed on the image. 
Furthermore, including an outline of the vehicle in such a predicted path gives a driver 
the sense of a positional relationship relative to an obstacle, thereby facilitating 
manipulation of the steering wheel during general parking or reverse parking. 
(Embodiment) 

Hereinafter, an embodiment will be described with reference to the 
accompanying drawings. 

FIG 1 is a drawing showing an embodiment of a vehicular predicted path 
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display device according to the present invention. FIG 2 is a drawing showing an 
example of an attachment position of a camera. FIG 3 is a drawing showing an 
example of a display of a predicted path by the vehicular predicted path display device 
according to the present invention. FIG 4 is an explanatory drawing of a calculation 
example of the predicted path. 

In FIG 1, a video camera 7 is attached at a position where a rear field of vision 
[FIG 2(a)] or a side rear field of vision [FIG 2(b)] of a vehicle can be filmed. Filming 
a portion of the vehicle (a maximum rear or maximum side portion) in this case allows 
easy recognition of the distance between the vehicle and an obstacle upon approaching 
that obstacle. A path calculation computer 2 stores a predicted path for a turning angle 
of a steering wheel during reverse travel in an internal memory. When reverse travel is 
detected by a reverse detection switch 3 (reverse gear), the path calculation computer 2 
reads the turning angle of the steering wheel from a steering sensor 1, and reads out a 
predicted path for the turning angle of the steering wheel from the internal memory. A 
path overlapping device 6 inputs the image of the rear or the side field of vision from 
the video camera 7 attached to the vehicle and the predicted path read out by the path 
calculation computer 2. The path overlapping device 6 then overlaps and displays 
(superimposes) the image and the predicted path on a display 8. 

Thus, using the predicted path on the image of the rear or side field of vision 
on the display 8, the driver is able to grasp the direction of travel determined by the 
turning angle while backing up. Therefore, in terms of perception, driving with 
reference to the display content is possible even if the image from the video camera 7 is 
distorted. Driving operations such as general parking and reverse parking, as well as 
checking for safety become easier. It should be noted that when attaching a light to 
illuminate the camera field of vision, a night illumination device 5 turns on such a light 
using a reverse detection switch 3 or light switch 4 of the vehicle. 

The superimposed predicted path may consist of more than just the vehicle 
path alone. For example, if the mounted position of the camera 7 is on the vehicle rear 
as shown in FIG 2(a), an outline of the vehicle body may also be shown on the screen 
by the camera 7 as illustrated in FIG 3(a), in order to emphasize the end portion of the 
vehicle. Furthermore, to create perspective, frames set at regular intervals may be 
drawn on the ground along the path as shown in FIG 3(b), or the vehicle body may be 
drawn as a box at a certain position according to the path of the front and rear wheels, as 
shown in FIG 3(c). Such measures can create a display that is easier to perceive. 

Such a predicted path is calculated and determined according to a turning angle 
of the steering wheel, for example, using the turning radius of the vehicle rear wheels, 
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front wheels, and the vehicle body as shown in FIG 4. More specifically, a conversion 
formula for converting the predicted path into coordinates on an image projected by a 
camera is determined depending on the attachment position and direction of the camera. 
By converting the predicted path into coordinates according to a shift from the present 
vehicle position corresponding to the respective turning angles, path data corresponding 
to each turning angle is created as plotted points on a pair of right and left curves. This 
data is then stored in a ROM of the path calculation computer 6. 

Note that the present invention is not limited to the above embodiment, and 
may have various modifications. For example, in the above embodiment, the path 
calculation computer calculates and stores the predicted path in advance. However, 
the path calculation computer may calculate and superimpose the predicted path as 
necessary. 

FIG 5 is an explanatory drawing of a program processing flow used for 
creating path display data by a path calculation computer. FIG 6 is an explanatory 
drawing of a program processing flow used for calculating path display data by the path 
calculation computer FIG 7 is an explanatory drawing of a processing flow of an 
execution program. FIG 8 is an explanatory drawing of a calculation of a turning 
radius and a center thereof. FIG 9 is an explanatory drawing of a calculation of 
coordinate points on a turning circle. FIG 10 is an explanatory drawing of a 
conversion to a fisheye view. 

Two programs perform processing in the vehicular predicted path display 
device according to the present invention: a program for creating path display data 
shown in FIG 5 that writes data on a file for displaying a path on the screen, which is 
based upon a turning radius corresponding to the reading of a vehicle steering sensor 
and the attachment position of the camera; and an execution program shown in FIG 6 
that reads the data and displays the path on screen. In addition, other programs may 
include a program for creating data to display frames on the path that give the driver 
perspective, a program for converting path coordinates to match distortions on the 
screen when using a super-wide-angle camera, and a program for interpolating data 
points when path data points are spaced far away on the screen. In the system shown 
in FIG 1, the predicted path is found in advance and stored in the ROM. The turning 
angle is detected during driving, and the predicted path data is read out from the ROM 
based on the value of the turning angle. In such a construction, at least the execution 
program among the programs described above should be provided as the program used 
during normal driving. 

The program shown in FIG 5 creates 119 packets of path display data 
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corresponding to turning angle data STA of the steering wheel. The program shows an 
example of processing in which a coordinate calculation of the turning radius and a 
center thereof, a calculation of path display data for the rear wheel on the turning center 
side, and a calculation of path display data for the rear wheel on the turning circle side 
are sequentially performed until the turning radius data STA of the steering wheel 
reaches 1 to 119. The calculation results are then written to a file. Thus, 119 packets 
of path display data are created and stored. The program shown in FIG 6 is an 
example in which a turning direction is divided into right and left using 60 between STA 
1 to 119 as a boundary. The program consists of processing that performs a direct 
view conversion and fisheye view conversion, where coordinate points on the turning 
circle are calculated with a center angle tt/2 decreasing by decrements of a unit C, or a 
center angle 37i/2 increasing by increments of the unit C. The program shown in FIG 
7 reads out and displays path data or frame data from a data file. Steering changes are 
detected and data corresponding to such changes is displayed by the program. 

In the calculation of the turning radius and center thereof, a point on the ground 
at the center of the screen is set as an origin for coordinates as shown in FIG 8. The 
traveling direction of the vehicle on the ground is set as the y axis, and the x axis is set 
perpendicular to the y axis. L is the distance between the rear wheels and the x axis, 
and WL is the distance between the rear wheels and the camera position along the y axis. 
W is the vehicle width, and WR is the distance between the left side and the camera 
position along the x axis. In addition, a turning radius R is uniquely set according to 
the turning angle. Consequently, if the center angle is represented by c (- n in the 
figure), then the coordinate points (x cp , y cp ) of the turning circle on the rear wheel inside 
track are 

0* 1) 
(*2). 

If a point on the ground is converted into direct view coordinates on the screen where N 
is the distance from the camera to the coordinate origin on the ground and 8 is an angle 
as shown in FIG 9, then 

(i*3) 
(*4). 

Accordingly, the points (x s , y s ) on the screen are 

(5*5) 

(5t6). 

Note that d is a distance between the camera and the screen and a conversion parameter 
to unify coordinates on the screen. 
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In addition, using a super-wide-angle lens on the camera distorts the image on 
the screen and requires correction. The polar coordinate conversion in this case is 
(*7) 
(*8) 

therefore, the conversion from screen coordinates according to a standard lens in FIG 

10(a) to a distorted fisheye image in FIG 10(b) is 

(5*9) 

a, b: constants 
(5S 10) 
(5*11). 

As evident from the description above, according to the present invention, a 
predicted path calculated according to a present steering state is displayed on a screen 
image obtained by a camera that is provided so as to allow monitoring of the rear or side 
rear field of vision in a vehicle. Consequently, safety and operability when parking 
can be improved, because the driver may operate the vehicle while watching the 
predicted path when backing up. Furthermore, an outline of the vehicle can also be 
combined in the display, thereby facilitating confirmation of a position relative to an 
obstacle. Since a camera is used, the field of vision is not limited as with a reflecting 
mirror, and the driver's line of sight is not restricted, thus securing a wide field of vision. 
Even in the case of a distorted image using a fisheye lens or the like, the present vehicle 
position and position relative to obstacles, as well as the predicted path, is displayed in a 
manner easy for the driver to understand. Therefore, operating the vehicle while 
watching a distorted image is also possible. 

4. Brief Description of the Drawings 

FIG 1 is a drawing showing an embodiment of a vehicular predicted path 
display device according to the present invention; FIG 2 is a drawing showing an 
example of an attachment position of a camera; FIG 3 is a drawing showing an example 
of a display of a predicted path by the vehicular predicted path display device according 
to the present invention; FIG 4 is an explanatory drawing of a calculation example of 
the predicted path; FIG 5 is an explanatory drawing of a program processing flow used 
for creating path display data by a path calculation computer; FIG 6 is an explanatory 
drawing of a program processing flow used for calculating path display data by the path 
calculation computer; FIG 7 is an explanatory drawing of a processing flow of an 
execution program; FIG 8 is an explanatory drawing of a calculation of a turning radius 
and a center thereof; FIG 9 is an explanatory drawing of a calculation of coordinate 
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points on a turning circle; and FIG 10 is an explanatory drawing of a conversion to a 
fisheye view. 

1 STEERING SENSOR 

2 PATH CALCULATION COMPUTER 

3 REVERSE DETECTION SWITCH 

6 PATH OVERLAPPING DEVICE 

7 VIDEO CAMERA 

8 DISPLAY 
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[FIG 1] 

1/STEERING SENSOR 

2/PATH CALCULATION COMPUTER 

3/"R" DETECTION SWITCH 

4/LIGHT SWITCH 

5/NIGHT ILLUMINATION 

6/PATH OVERLAPPING DEVICE 

7/CAMERA 

8/DISPLAY 

[FIG 3] 

1/DISPLAY SCREEN 
2/PREDICTED PATH 
3/VEHICLE END OUTLINE 

[FIG 5] 

1AVRJTE CALCULATION RESULTS TO FILE 
2/CALCULATE RADIUS AND TURNING CENTER COORDINATES 
3/CALCULATE PATH DISPLAY DATA FOR REAR WHEEL ON TURNING 
CENTER SIDE 

4/ CALCULATE PATH DISPLAY DATA FOR REAR WHEEL ON TURNING 
CIRCLE SIDE 

[FIG 6] 

1/CI CENTER ANGLE = n/2 
2/CENTER ANGLE >0 

3/CALCULATE COORDINATE POINTS ON TURNING CIRCLE 

4/DIRECT VIEW CONVERSION 

FISHEYE CONVERSION 

5/CENTER ANGLE = CENTER ANGLE - C 

6/CENTER ANGLE = 3n/2 

7/CENTER ANGLE < 2n 

8/CALCULATE COORDINATE POINTS ON TURNING CIRCLE 

9/DIRECT VIEW CONVERSION 

FISHEYE CONVERSION 

10/CENTER ANGLE = CENTER ANGLE + C 
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[FIG 7] 

1/READ OUT FILE DATA 
2/READ STEERING INPUT 
3/CHANGE? 
4/DISPLAY PATH 

[FIG 8] 

1 /POINT ON GROUND AT CENTER OF CAMERA IMAGE 
2/CAMERA POSITION 
3/(TURNING RADIUS) 

[FIG 9] 
1 /CAMERA 

[FIG 10] 

1/SCREEN ACCORDING TO STANDARD LENS 
2/DISTORTED IMAGE 
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